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Abstract 

We obtain Euler-Lagrange and transversality optimality conditions for higher-order infi- 
nite horizon variational problems on a time scale. The new necessary optimality conditions 
improve the classical results both in the continuous and discrete settings: our results seem 
new and interesting even in the particular cases when the time scale is the set of real numbers 
or the set of integers. 
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1 Introduction 

We consider infinite horizon variational problems on time scales, which consist in maximizing a 
delta integral with a Lagrangian involving higher-order delta derivatives on a given unbounded 
time scale. Problems of the calculus of variations of such type have many applications in economics 
both in discrete (i.e., when the time scale is the set of integers) and continuous (i.e., when the 
time scale is the set of real numbers) time settings (see, e.g., [3H]). Indeed, the dynamic processes 
of economics are usually described with discrete or continuous models. The time scale approach 
adopted here puts discrete and continuous models of economics together and, most important, 
extends them to more realistic situations of unequally spaced points in time (time-varying grain- 
iness). Consider a typical situation of a consumer, that has to make decisions concerning how 
much to consume and how much to spend with the goal to maximize his lifetime utility subject to 
certain constraints. Problems of the calculus of variations on time scales provide a natural way to 
model such a consumer, that has an income from different sources, at unequal time intervals, and 
makes expenditures also at unequal time intervals [3]. The reader interested on the usefulness of 
the calculus of variations on time scales in economics is referred to [3 6 J and references therein. 
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Clearly, for infinite horizon variational problems, the delta integral does not necessarily con- 
verge: it may diverge to plus or minus infinity or it may oscillate. In such situations, the extension 
of the standard definition of optimality used in the time scale setting (see, e.g., [7JIH]) to the un- 
bounded time domain is not useful. Indeed, if, for example, for every admissible function the value 
of the integral functional is equal to plus infinity, then each admissible path could be called an op- 
timal path. To handle this and similar situations in a rigorous way, several alternative definitions 
of optimality for problems with unbounded time domain have been proposed in the literature (see, 
e.g., [9TU2]). In this paper, we follow the notion of weakly optimal solution introduced by Brock 
in the economic literature. In the case when the variational functional converges for all admissible 
paths, Brock's notion coincides with the standard definition of optimality. Many results in infinite 
horizon optimal control with this type of optimality can be found in the book [T3] . For the method 
of discrete approximations, that allows to approximate continuous-time control problems by those 
associated with discrete dynamics, we refer the reader to |14) . 

The goal of this paper is to provide necessary optimality conditions to higher-order infinite 
horizon variational problems on time scales. Our main result is Theorem 13.11 It provides a 
nontrivial generalization of the recent results of [T5JH6] ■ Moreover, Theorem 13.11 improves the 
continuous results of Okomura et al. [17] when one chooses the time scale to be the set of real 
numbers, while, in the particular case when the time scale is the set of integers, it generalizes the 
discrete-time results of Cai and Nitta [15] , 

The paper is organized as follows. In Section [21 we present some preliminary results and basic 
definitions necessary in the sequel. Main results are given in Section [3j in Section I3.1[ we prove 
some fundamental lemmas of the calculus of variations for infinite horizon variational problems; 
the Euler-Lagrange equation and the transversality conditions for higher-order infinite horizon 
variational problems are proved in Section 13.21 and discussed in Section 13.31 We end the paper 
with two illustrative examples (Section 0]) and a summary of the major results (Section [5]) . 

2 Preliminaries 

A time scale is an arbitrary, nonempty and closed subset T of R (endowed with the topology of 
a subspace of K). In a time scale T, we consider the following two operators: the forward jump 
operator a : T — >• T, defined by a{t) := inf {s € T : s > t} if t ^ supT and cr(supT) := supT, and 
the backward jump operator p : T — > T, defined by pit) := sup{s € T : s < t} if t ^ inf T and 
p(inf T) := inf T. A point t £ T is called right-dense, right-scattered, left-dense or left-scattered if 
and only if er(£) = t, ait) > t, pit) = t or pit) < t, respectively. We say that t is isolated if and 
only if pit) < t < ait), t is dense if and only if pit) = t = ait). The mapping p ; T — > [0, +oo[ is 
defined by p(t) := ait) — t and is called the graininess function. 

In order to introduce the definition of delta derivative, we define a new set T K . If T has a 
left-scattered maximum M, then T K = T \ {M}, otherwise, T K = T. 

Definition 2.1. We say that a function f : T — » K is delta differ entiable at t 6 T K if and only if 
there is a number f A it) such that, for all e > 0, there exists a neighborhood U of t such that 

|/(<r(i)) - f(s) - f A it)iait) - s)\ < e\ait) - s\ for all s e U. 

We call f A (t) the delta derivative of f at t. Moreover, we say that f is delta differ entiable (or 
A-differentiable) on T provided / A (t) exists for all t E T K . 

Remark 2.1. If T = M, then f A = f , where f denotes the usual derivative on R. If T = Z, 
then f A = fit + 1) — fit), i.e., f A is the usual forward difference. For any time scale T, if f is a 
constant, then f A — 0; if fit) — kt for some constant k, then f A = k. 

In order to simplify expressions, we denote the composition / o a by f a . 

Theorem 2.1. [19] Let T be a time scale, f : T — > K, and t G T K . The following holds: 

1. If f is delta differ entiable at t, then f is continuous at t. 
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2. If f is continuous at t and t is right-scattered, then f is delta differentiable at t and 

3. If t is right-dense, then f is delta differentiable at t if and only if the limit 

s-yt t — S 

exists as a finite number. In this case, 

s->t t — s 

4. If f is delta differentiable at t, then f a (t) = f{t) + /i(i)/ A (t). 

Definition 2.2. Let f, F : T — > M. Function F is called a delta antiderivative of f if and only if 
F A (t) = f(t) for all i 6 T K . In this case we define the delta integral of f from a to b (a,b £ T) by 

b 

f(t)At:=F(b)-F(a). 

Definition 2.3. A function f : T — > K is rd-continuous if and only if it is continuous at the 
right-dense points and its left-sided limits exist (finite) at all left-dense points. The set of all 
rd-continuous functions f : T — >• M is denoted by C r d(T, R). 

Theorem 2.2. [19] Every rd-continuous function f : T — >• M has a delta antiderivative. In 
particular, if a € T, then the function F defined by 



F(t) := / /(r)Ar, teT, 

J a 



is a delta antiderivative of f . 

Theorem 2.3. [19] // a, b, c € T, a < c < b, a £ R, and f,g e C rd {T,R), then 
(/(t) + <?(*)) At = f f(t)At+ [ g(t)M; 



r b 

:>. I af(t)At = a j /(/)A/: 
3. f f(t)At = - I f(t)At; 



I / f(t)At = 0: 

5. f f(t)At = f f(t)At + f f{t)At; 

J a J a J c 

6. if f(t) > for alia <t< b, then f f(t)At > 0; 

J a 

7. If f and g are A -differentiable, then 

(a) [" nt)g A {t)At=[{fg){t)]\Z h a - [" f A (t)g(t)At; 
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(b) I f{t)g A {t)At = [{fg){t)]\Z h - l" f A (t)g°(t)At 



For more definitions, notations, and results concerning the theory of time scales, we refer the 
reader to the books [19,20 . In what follows, a denotes the forward jump operator and A is the 
delta derivative of a given time scale T. As usual, for / : T — >• K we define f u := f o a k , where 
a k := a o a , k G N, and a = id. We assume that T is a time scale such that supT = +00 
and we suppose that a,T,T' G T are such that T" > T > a. Let r G N and f A ° := /. The 

rth delta derivative of / : T -> R is the function f A : T K ->• R defined by / A := (/ A , 

provided / A is delta differentiable. By diF we denote the partial derivative of a function F with 
respect to its ith argument. All intervals are time scales intervals, that is, we simply write [a, b] 
and [a, +oo[ to denote, respectively, the set [a,b] PlT and [a, +oo[nT. We consider the following 
higher-order variational problem on T: 



+00 

L 



(1) 



r+l 



x G C*J([a,+oo[,R) 
x A (a) = at, i = 0, . . . , r — 1, 

where r £ N, ao, . . . , a r -i are fixed real numbers, (uq, . . . , u r ) — > L(t, Uo, • • ■ , u r ) is a C (1 
function for any t G [a, +oo[, and di+2L G C,^ d ([a, +oo[, M) for all z = 0, . . . , r. 

Remark 2.2. The results of this paper are trivially generalized for functions x : [a,+oo[— > R n 
(n G N), but for simplicity of presentation we restrict ourselves to the scalar case (n = X). 

Definition 2.4. We say that x is an admissible function for problem |T]) if and only if 

x G C^J([a, +00 [, R) and x A (a) =014, i = 0, . . . , r — 1. 
As optimality criteria, we use the following generalization of Brock's notion of optimality. 
Definition 2.5. Function x* is weakly maximal to problem ([1} if and only if x* is admissible and 



lim inf 

T^+oo T'>T 



T' 

'l 



(t,x° r (t),x^ lA (t),...,x° Ar -\t),x Ar (t)) 

-L (t, xf(t),xf- lA (t), < Ar_1 (t), xf (t)) 

/or admissible function x. 



At<0 



It is well known that, for certain time scales T, the forward jump operator a is not delta 
differentiable. Furthermore, the chain rule, as we know it from the classical calculus, that is, when 
T = R, is not valid in general. However, if we suppose that the time scale T satisfies the condition 

(H) for each t G T, (r — 1) (<r(t) — ait — do) = for some a\ G R + and ao G R, 

then we can deal with these two limitations as noted in Remark 12.31 and Lemma 12.11 

Remark 2.3. Condition (H) is equivalent to r = 1 or o~(t) = ait + oq for some a% G R + and 
ao G R. Thus, for the first order infinite horizon variational problem \ 15]/ , we impose no restriction 
on the time scale T. For the higher-order problems (i.e., for r > 2) such restriction on the time 
scale is necessary. Indeed, for r > 1 we are implicitly assuming in ([IJ that a be delta differentiable, 
which is not true for a general time scale T. Note that, for r > 1, condition (H) implies that a 
be delta differentiable and o A {t) = a\, t G T. Furthermore, note that condition (H) includes the 
following important cases: the differential calculus (T = R, a\ = 1, ao = 0); the difference calculus 
(T = Z, a\ = 1, ao = 1 ); the h-calculus (T = KL := {hz : z G Z} for some h > 0, a\ = 1, oq = h); 
and the q-calculus (T = g N ° := {q k : k G No} for some q > 1, a\ = q, a = 0). 
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Lemma 2.1. |21j Let T be a time scale satisfying condition (H) and r > 1. If f : T — » M is iwo 
times delta differentiable, then f' jA {t) = a\f ArT it), t € T. 

The next lemma will be very useful for the proof of our higher-order fundamental lemmas of the 
calculus of variations on time scales (more precisely, will be useful for Lemma 13.51 and Lemma |3.7[) . 
An analogous nabla version can be found in |22j . 

Lemma 2.2. Assume that the time scale T satisfies condition (H) and r\ € C^([a, +oo[, R) is 
such that n A (a) = for all i = 0, . . . , r. Then, rf A (a) = for each i = 1, . . . , r. 

Proof. If a is right-dense, then the result is trivial (just use Lemma l!01 and the fact that a(a) = a). 
Suppose that a be right-scattered and fix i S {1, . . . , r}. Since 

^ A («)=('7 A ) W = ^ ^-n 

?7 Ai (a) = 0, and ^"'(a) = 0, then (v^Y {a) = 0. By LemmaHU 

V ^ 1 (a) = (a l y- 1 ( V A ^y (a), 

proving that rj crA ' 1 (a) =0. □ 
We end this section recalling a result that will be needed in the proof of our Theorem 13. II 

Theorem 2.4. |23) Let S and T be subsets of a normed vector space. Let f be a map defined 
on T x S , having values in some complete normed vector space. Let v be adherent to S and w 
adherent to T. Assume that: 

1. liuLc-n, fit, x) exists for each t G T ; 

2. Yim. t ^, w fit, x) exists uniformly for x 6 S . 

Then the limits Y\m. t ^, w lim x _>,, fit, x), \i'ai x ^ fV \\n\t^ fW f{t,x), and lirn/ tx )_ > ( u)t ,) f(t, x) all exist 
and are equal. 



3 Main Results 

We prove a first-order necessary optimality condition for higher-order infinite horizon variational 
problems on time scales. For simplicity of expressions, we introduce the operator (-} r defined by 
(xy(t) := (t,x^(t),x^- lA (t),...,x- Ar -\t),x Ar (t)y 

Theorem 3.1 (Euler-Lagrange Equation and Transversality Conditions). Let T be a time scale 
satisfying condition (H) and such that supT = +00. Suppose that x* be a maximizer to problem 
(P) and let n e C^ 7 d ([a, +oo[,M) be such that 77(a) = 0, n A {a) = 7 . . . , rj^' 1 (a) = 0. Define 

T ' L (x*+e V y(t)-L(x*nt) M 



A(e,T') ■= I 

J a 

V{e,T) := M t f (l(x. + en) r (t) - L(x.) r {tj) At 



Vie):= lim Vie, T). 



Suppose that 



Vie,T) 

1. lim exists for all T; 

e^O e 
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V(e,T) 

2. lim ■ exists uniformly for e; 

T-S.+00 e 

3. For every T' > a, T > a, and e G K. \ {0}, there exists a sequence (A(e,T^)) n( - N such that 

hm A(e,r n ) = M A(e,r) 

n— > + oo T'>T 

uniformly for e. 
Then x* satisfies the Euler-Lagrange equation 



for all t G [a, +oo[ and i/ie r transversality conditions 
( / fc-l 



EHHH 2 (a i+2 £) A >rw = o (2) 



^m^n^ ( 9 r+2 _ (fe _ 1) L(^)'"(T') + ^(-1)* (a r+2 _ (fc _ 1)+ . i L) A (x) r (T r ) ■ %{k)j 

x/" lAr "(T')|=0, (3) 



r-(fc-l)+(j'-l) 



The proof of Theorem 13.11 is given in t j3.2l Before that we state and prove several useful 
auxiliary results. In particular, we prove in ij3.ll a higher-order integration by parts formula 
(Lemma 13. 1|) and three higher-order fundamental lemmas of the calculus of variations on time 
scales (Lemmas I3.5[ 13.61 and 13. 7| . 



3.1 Fundamental Lemmas 

In our results we use the standard convention that X)fe=i 7(^0 = whenever j = 0. 

Lemma 3.1 (Higher-order integration by parts formula). Let r G N, T be a time scale satisfying 
condition (H), a, b G T, a < b, f G C^ d {[a,a r (b)],R), and g G C%([a,a r (b)],R). For each 
i = 1, . . . , r we have 

f w" ai mi = fw-'*'- 1 (t) + 5>i) v a * (t) 9 ^ +k A ^ k (t) ■ n ( -) 1 

Ja fc=l j=l V® 1 ' 

9 

A* 



+{ ~ iy SAvi) / a "(*)^'(*)a*. 

Proof. We prove the lemma by mathematical induction. If r = 1, the result is obviously true: 
it coincides with the usual integration by parts formula on time scales. Assuming that the result 



G 



holds for an arbitrary r, we will prove it for r + 1. Fix i = 1, . . . , r. By the induction hypotheses, 



f(t)g^^ A \t)At = / /(t)(,fr" A >)At 

a 



+ (-ir 



fe=i 

'('-!) 



Ol 



3=1 



/ A *(t)(a<T»At 



/(*)<?' 



- r +'- i A i - 1 



(*) + E(-i) fe / Afc w^ +i ^ A ™ w • n f 1 



k=l 

'('-!) 



3=1 



It remains to prove that the result is true for i — r + 1. Note that 



f(t)g*--(t)At= I f(t)(g A ) AT (t)At 



f(t)( 9 A r-\t)+ r j2(-i) k f Ak (t)( 9 A r kAr - i - k (t ) . n (- 



+ (-!)' 



1 

r-l 



fc=l 

r(r-l) 



fc / i \ r-j 



3=1 



/ (t)(g V (by induction hypotheses) 

■1 b 

/(«)^ r (*)+i:(-i)v Afc (*)^ Ar "*(*)- f-Kfri (-K ' 



+ (-ir 



^=1 
i 

Ol 



Ol 



3=1 



/ ) (*)Ai (by Lemma ET 



Using the standard integration by parts formula in the last delta integral, and taking into account 



that (^faii (0 ' = nj=i (ir) r+1 ^, we conclude that 



[ f(t)g A " + \t)At = 

J a 



f(t)9 Ar (t) + Y^(-l) k f Ak (t)g° kAr - k (t) ■ f] (1 



k=l 



(-lYf Ar (t)g" r (t) 



(-iy 



/ , \ r+l-j 

3 = 1 

r(r+l) 



/ A (t). 9 CT (t)At 



f{t)g A \t) + j2(-l) k f Ak (t)g° kAr - k (t) ■ [] (1 



+ (-1) 



r+l 



fc=l 

6 



3 = 1 



f Ar+ \t)g° r+ \t)At, 



k i \ r+l-j 
Ol 



proving that the result is true for i = r + 1. □ 
Before presenting the higher-order fundamental lemmas of the calculus of variations on time 
scales, we need the following three preliminary results. 
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Lemma 3.2. Suppose that a G T and f G C r d([a, +oo[, R) 6e smc/i t/iat f > on [a,+oo[. If 



lim inf / /(t)At = 0, 

T^+^T>>Tj a 

then f = on [a, +oo[. 

Proof. Suppose, by contradiction, that there exists to € [a, +oo[ such that /(to) > 0. Fix b G T 
such that ao < to < &• We will prove that /(t)At > 0. If to is right-scattered, then 

/(t)At = / /(t)At + / /(t)At + / /(t)At 



Ja J t Q J a(to) 

/■T(to) 

> / /(t)At = /(t ) (<7(t ) - to) > 0. 

J to 

If to is right-dense, then, by the continuity of / at t , there exists S > such that /(t) > for all 
t G [to, to + S[ and, therefore, 



/ /(t)At= / /(t)At+ / /(t)At+ / /(t)At 

/■to+5 

> / /(t)At>0. 
./to 

Then, for any T > b, 

inf / T /(t)At = / T /(t)At > ( /(t)At > 0, 

— J a J a J a 

lim inf [ f(t)A > { /(t)At > 0, 
^T>> T J a JK> ~ J a Jy> 

Lemma 3.3. Let f G C rd ([a, +oo[, R). // 

lim inf / f(t)n A (t)At = 



and hence 

inf / 

which is a contradiction. □ 



inf /" 

for all rj G C* d ([a, +oo[,R) such that 77(a) = 0, t/ien /(t) = c for all t G [a, +oo[, where c G 
Proof. Fix r,T'6T such that T' > T > a. Let c be a constant defined by the condition 



/ (/(7 
J a 



c) At = 0, 

J a 

and let ^ 

V(t)= ( (/(r)-c)Ar. 

Clearly, 77 G C^([a, +oo[,M), 7i A (t) = f(t) - c, 

V (a) = [ (/(r) - c) At = 0, and V (T') = f (/(t) - c) At = 0. 

Observe that 



f (f(t)-c)r 1 A (t)At = [ (f(t)-c) 2 At 

J a J a 



8 



and / it, 

I (f(t)-c) V A (t)At = f f(t)n A (t)At-c f V A (t)At = [ f(t)n A (t)At. 

Hence, 

lim inf f f(t)n A (t)At = lim inf f (f(t)-c) 2 At = 0, 

which shows, by Lemma T3. 21 that f(t) — c = for alH G [a, +oo[. □ 
Lemma 3.4. Let f,g€ C r d{[a, +oo[, R). // 

T ljm x Mt T £ (f(t)^(t) + <?(i)^ A (t)) At = 

/or a/Z 77 G Cy d ([a, +oo[, R) such that n(a) = 0, then g is delta differentiable and 

g A (t) = f(t) Vte[o,+oo[. 

Proof. Fix T,T'eT such that T > T > a and define A(t) = J a * /(t)At. Then A A (t) = f(t) for 
all t G [a, +oo[ and 

rj-\t rj-t/ r^\l 

A(t)n A (t)At = [A(t)n(t)] T a ' [ A A (t)n° (t)At = A(T')n(T') [ f(t)n°(t)At. 
Restricting 77 to those such that r}(T f ) = 0, we obtain 

T lim^nf T f T (f(t)^(t)+g(t) V A (t)) At = ^jm^m^ f (-A(t) + g(t)) V A (t)At = 0. 



By Lemma 13.31 we may conclude that there exists c G R such that — A(t) + g(t) = c for all 
t G [a, +00 [. Therefore, A A (t) = g A (t) for all t G [a, +oo[, proving the desired result: g A (t) = f(t) 
for all t G [a, +00 [. □ 
We are now in conditions to prove the following three fundamental lemmas of the calculus of 
variations for higher-order infinite horizon variational problems on time scales. 

Lemma 3.5 (Higher-order fundamental lemma of the calculus of variations I). Let T be a time 
scale satisfying condition (H) and such that supT = +00. Suppose that fo G C r d([a, +oo[, R), 
h G C r 1 d ([a,+oo[,R), f r G C£,([a, +oo[,R). If 



for allri G C%{[a, +oo[,R) sudi that n (a) = 0, ?y A (a) = 0, ^^(a) = 0, ffeen 



(1) 2 /f(t) = o Vte[a,+4 



ai 

Proof. We prove the lemma by mathematical induction. If r = 1, the result is true by Lemma 
Assume now that the result is true for some r. We will prove that the result is also true for r + 1 
Suppose that 

rpl /r + 1 



— J a \ ,-_ n / 



v i=0 

for all f] G C 2 r { d r+1) {{a, +oo[, R) such that n(a) = 0, n A (a) = 0, . . . , t] AT (a) = 0. We want to prove 
that 

r+1 



i=0 
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Note that 

rpl / r + l 



l (J>(*)^ +1 " A< (*)J At=^ (E^W^ + " IAl Wj At +1 fr+i(t) (rj Ar ) (t)At 
Using the integration by parts formula in the last integral, we obtain that 

,F f r+ i(t) (v A ") A (t)At = [f r+1 (t) v Ar (t)]^ - j T f r A +1 (t) (p Ar y (t)At. 
Since ?7 A (a) = and we can restrict ourselves to those r\ such that r\ Ar (T') = 0, then 



T /r+i(t) (v Ar ) A (t)At = - f T f r A +1 (t) (rf r ) a (t)At 



and, by Lemma 1270 



T' 



fr+i(t) (r, A ") A (t)At = -J f A +1 (t) (J-J V ° Ar (t)At 



Hence, 



r r /r+l _ \ 

= / E/^ +1 ~ iA >) A *- / /. 

• /a \i=0 / Ja 

= / T (^)^ <Ai w + (frit) ~ f? + i(t) (^y) (^) a "w 



At 



and. therefore, 



rpf /r+l 



^Mrj [Em^ +1 - iAi (t) At 

= rfeoT^rjf E /iW ^ CT ) ar " <A< (*) + (/»•(*) - ^i(<) (£)') 



At = 0. 



By Lemma [2?2| r? CT (a) = 0, (77 CT ) A (a) = 0, . . . , «) Ar 1 (a) = 0. Then, by the induction hypothesis, 
we conclude that 



ai 

t — u 

for all t G [a, +00 [, which is equivalent to 

i=0 



1 



«1 



fr(t)-f, 



(t) = 



E(-d j 



/ A *(t)=0 Vie[a,+oo[ 



□ 



Lemma 3.6 (Higher-order fundamental lemma of the calculus of variations II). Let T be a time 
scale satisfying condition (H) and such that supT = +00. Suppose that /o 6 C r d([a, +00 [, R) and 
fi eC; d ([a, +oo[,R) for alii = l,...,r. If 



lim inf / f y2fi(t)v a " tA \t) j A< = 
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for all T) e C^([a, +oo[,R) such that 77(a) = 0, ?7 A (a) = 0, . . . , r/ A (a) = 0, then 



Proof. Note that 



rril ty / rj-il \ 



T' 



f (t)r)° (t)At 



E 



mw-'*- 1 (t) +^irfr(t)v^' +kA '^ k (*) • n f- 



T' 



ai 



fe=i 



ai 



i=i 



E / - J f A \t)r)° r (t)At (by Lemma E 



v ° r (t)At 



E 



aw^ 4 - 1 ^) + E(-i) fc /^ (t)rr r - ,+k *- 1 - k (t) ■ n 



X 1 ' / r 



E(-dv, w ( - 



i=0 
r-l 

E 



fe=l 

i(i-l) ' 



r) a (t)At 



/c=i 



r-l 



/rCtv^w +E(- i ) fe /^w^ A """w • n ( 1 



fc=l 



T' 



and, by Lemma 13.51 we get 



r-l 

E 



fc / 1 \ i—j 
ai) 



fe=i 

/rW^w +E(-i) fe /, Afc (^ A " _ " fc w • n 



fe=l 

Therefore, restricting the variations 77 to those such that 



/ -1 \ r— 7 



(T')=rf (o) = 0, fc = l,...,r-l, 
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V (T')=^ A (o) = 0, fc = l,...,r-l, 

we get 



lim 

T-s-+oo 



(E/«(^" A! w) At = 0^ T lim ooi inf T {/ r (T') 7? A "- 1 (T')} =0, 



proving the desired result. □ 

Lemma 3.7 (Higher-order fundamental lemma of the calculus of variations III). Let T be a time 
scale satisfying condition (H) and such that supT = +oo. Suppose that f G C r d([a, +oo[, M) and 
/j S C^ d ([a, +oo [, H.) /or all i = 1, . . . ,r. If 

lim inf / (y/iW/'^W ] A* = 
for all 7) E C^([a,+oo[,R) swc/i that i] (a) = 0, i] A {a) = 0, rr^ 1 (a) = 0, tften 



* / 1 

/or all k — 1, . . . , r, where ^l(k) = Y\ ( — 



i=l 

r -(fc-i)+0'-i) 



Proof. We do the proof by induction. Let r = 1. Using the integration by parts formula and 
Lemma l3~5l we obtain limT^+oc infr'>T fi(T')r)(T') — 0, showing that the result is true for r = 1. 
Assuming now that the result holds for an arbitrary r, we will prove it for r + 1. Suppose that 



r T ' f r+1 _ \ 

lim inf / [Y / f i (t)ri° r+1 - tAt (t)}At = 



E 

vi=0 

for all r; G ([°' +°°[) ^) sucri that r; A (a) = 0, i — 0, . . . , r. We want to prove that 

( / fc-i 



»=1 



X ^-A— (TO l =0 (4) 

for fc = 1, . . . , r + 1. Fix some k — 2, . . . , r + 1. The main idea of the proof is that the fcth 
transversality condition for the variational problem of order r + 1 is obtained from the (k — l)th 
transversality condition for the variational problem of order r. Using the same techniques as in 
Lemma 13.51 we prove that 



T^>+ 

implies 

rp/ / r —X 



r T' /r+1 _ \ 

lim inf / V fdt)r} ar+1 ' A \t) ) At = 



T^ooT^T \ l h{t) Wf iAi (t) + [frit) - / r A +1 (t) (^) ) (rfr\t)j At j = 0. 
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Since, by Lemma I2T21 r] a (a) = 0, (?? CT ) A (a) = 0, . . . , «) Ar (a) = 0, then, by the induction 
hypothesis for k — 1, we conclude that 



' k-3 



r lim^ mf T |^(-ir(/ r -( fc - 2)+i ) (T') • - 1) + (-l) fc - 2 (/ r ) (T') • %_ 2 (k 1) 

+/ I -( fc - 2) (T0 + (-i) fc - i (/, + i) A " 1 (T0-n_ 2 (fc-i)(i) r V on^'-^V)] = o, 



fc-i 



which is equivalent to 

rS?oor^r{ (^-(^)(T0 + £(-1)' (/r-^-^f CO • *K* - 1)J 

x^-^-^^TO^O. 

This proves equation Q for fc = 2, . . . , r + 1. It remains to prove that equation Q is also true for 
k = 1. This condition follows from Lemma 13.61 □ 



3.2 Proof of Theorem I3TT1 

Using our notion of weak maximality, if is optimal, then V(e) < for every e € M. Since 
V^(0) = 0, then is an extremal point of V. We will prove that V is diffcrcntiable at t = 0, and 
hence V'(0) = 0. Note that 

V(0) = ]im^ = lim hm ^L_2 
U(e,T) 

= lim lim ■ (by hypothesis 1 and 2 and Theorem 12.41) 

= lim lim inf A(s, T') 

T^+oce^0T'>T 

= lim lim lim A(e, T') (by hypothesis 5) 
= lim lim lim Afe, T ) (by hypothesis 3 and Theorem 

T— >+oo n-H-oo E->-0 

= lim inf \im A(e.T') (by hypothesis 3) 
= lim inf hm f + e Vm - Lj^jt) ^ 



T^>+ooT'>T e^O J a £ 

hm inf r\ n ^ + e, n t)-L {x , nt ) M 
r-i+cx)T'>r J a e^a e 

lim inf [ T V8 i+2 L(i,) r (().< r " iAi (i) ] At. 



Therefore, 



lim inf / \S2d i+ 2L(x*) r (t) 



■ jf* * A "(i) I At = 0. 



T 

Using Lemma 13.51 we conclude that 



E(-l)M-) 2 (d l+2 hf {x^(t)=0 Vte[a,+co[ 



i=0 x 
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proving that a;* satisfies the Euler-Lagrange equation By Lemma 13.71 we conclude that 
r Um^nfJ (d r+2 _ ik _ 1) L(x m nT f ) + ^(-l) 1 (9, +2 - (fe - 1)+l T) A! (x*) r (T') ■ %(k)\ 

=0 (5) 

for k = 1, . . . ,r. Consider 7/ defined by rj{t) = a(t)x*(t) for all t G [a. +oo[, where a : [a, +oo[— >■ R 
is a Cy^ function satisfying a(a) = 0,a A (a) = 0,...,a A (a) = 0, and there exists To e T 
such that a(t) = /3 e R \ {0} for all t > T . Note that 57(0) = 0,n A (a) = 0, . . . ,rj AT ~\a) = 0. 
Substituting r\ in equation (JSJ), we conclude that 



fc-l n 

lim^ mfj ( a r+3 _ (fc _ 1) L( a! ,) r (T') + £(-1)' (d r+ 2-(k-i)+i^ (x*) r (T') ■ %{k) 



T->+oo T'>T 



x<~~ Ar ~~(T')j=0, 
proving that x* satisfies the transversality condition ([3]) for all k = 1, . . . , r. 
3.3 Remarks and Corollaries 

Note that we have actually proved that, for an infinite horizon variational problem of order r, one 
has r transversality conditions and that, for each k — 1, . . . , r, the fcth transversality condition has 
exactly k terms. To the best of our knowledge, even for the classical calculus of variations (i.e., 
when T = R or T = Z) our explicit formulas for the transversality conditions are new. 

Similarly to the special case when T = R (see [IT]) and when T = Z (see hypotheses 1, 

2, and 3 of Theorem 13 . 1 1 are impossible to be verified a priori because x* is unknown. In practical 
terms, such hypotheses are assumed to be true and conditions ([2]) and ([3]) are applied heuristically 
to obtain a candidate. If such a candidate is, or not, a solution to the problem is a different 
question that always require further analysis (see Examples 14.11 and 14.21 in Section Ql . 

For the convenience of the reader, we present the particular cases of Theorem 13.11 for r=l, 
r = 2, and r = 3. 

Corollary 3.1. [15] Assuming hypotheses of Theorem \3.1\ for r — 1, if x* is a maximizer to 
problem fT]). then x* satisfies the Euler-Lagrange equation 

{d 3 L) A (t,x a {t),x A {t)) = d 2 L{t 1 x°(t),x A (t)) Vte [a,+oo[, 

and the transversality condition 

lim inf {d 3 L(T',x' T (T'),x A (T')) ■ x(T')\ = 0. 

Corollary 3.2. Assuming hypotheses of Theorem \3.1\ for r = 2, if x* is a maximizer to problem 
(fTj) , then x* satisfies the Euler-Lagrange equation 

d 2 L(x) 2 (t) - (d 3 L) A (x) 2 (t) + — {d A Lf 2 {x) 2 (t) = Vt e [a, +oo[ , 

ax 

and the two transversality conditions 

lim inf {diLUfiT 1 ) ■ x A (T')\ = 0, 

rHm^mf, I (d 3 L(xf(T>)~ A (9 4 T) A (x)*(T')Y x°(T')\ = 0. 
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Corollary 3.3. Assuming hypotheses of Theorem \3.1\ for r = 3, if x* is a maximizer to problem 
([T]) 7 then x* satisfies the Euler-Lagrange equation 

d 2 L(xf(t) - (d 3 L) A (x) 3 (t) + (1) (d 4 Lf 2 (x) 3 (t) - (J-} 3 (3 5 Lf 3 (x) 3 (t) =0 We [a, +oo[ , 

and the three transversality conditions 

lim inf \d 5 L(x) 3 (T') ■ x A * (T')\ = 0, 

^m^rf { (d 4 L(x) 3 (T>) (J-YfyLf (x) 3 (T')\ ■ ^ A (T')| = 0, 



^ mf T J Ul^CO - (1) (d 4 L) A <*> 3 (T') + (J-^ (d 5 Lf 2 <*> 3 (T') j x^(T')\ = 0. 



U r%L(x) 3 (T') - ( — \ (c3AA A <x) 3 (T') + ( — 1 

T^+oo T'>T 

Considering T = K in Theorem l3.ll we get the following result that improves the results of [17] 
Corollary 3.4. Consider the problem 

+oo 

— > max 



(t,x(t),x>(t),...,x^(t)) 



x G C' r ([a, +oo [, R) (6 ) 
cc(a) = ao, cc^ r_1 ^(a) = a r -x, 

where (uq, . . . , u r ) — »• L(t,Uo, . . . ,u r ) is a C 1 (R r+1 , R) function for any t G [a, +oo[, ao, • • • , «r-i 
are /w;ed reaZ numbers, and di+iL G C r ([a, +oo[, R) /or alii = 1, . . . , r and aZ/ x G C r ([a, +oo[, R). 
Suppose that the maximizer to problem (J6)) exists and is given by x*. Let r\ G C r ([a, +oo[, R ra ) be 
such that rj(a) = 0, . . . , r^ -1 ) (a) = 0. Define 

r r L (t, x*(t) + eri(t), xi r) (t) + s^Ct)) - L (t, x*(t), x^Ot)) 
A(s,T'):= — i '- i J -dt, 

J a ^ 
f 7 " 

V(e,T) := mf / \L (t, x*(t) + er)(t), . . . , x^ (t) + e^ r \t)j - L{t,x*{t), ■ ■ ■ , 4 r) (*)) dt, 
V{e):= lim K( e ,T). 

T— >+oo 

Suppose that 

1. lim — — — - exists for all T: 
e^O e 

V(e,T) 

2. lim ■ exists uniformly for e; 

T-S.+00 e 

3. For every T' > a, T > a, and e G R \ {0}, i/iere exists a sequence (A(e,T^)) neI!j such that 

lim A(s,T^) = M A(s,T') 

n—^-\-oo T'>T 

uniformly for e. 
Then x* satisfies the Euler-Lagrange equation 

r 

^(-l) i; (d J+2 L) W (t,x(t),x'(t),...,x^{t)) =0 Vf G [a, +oo[ , 

i=0 
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and the r transversality conditions 

lim inf \ (d r+2 _ {k _ x) L (t,x(t),x'(t), . . .,z< r >(t)) 

+ J2(- l T (dr+2-(k^Lf } (t, x(t),x'(t), . . . , ^(t))) • ^- fe )(T') j = 0, 

k = l,...,r. 

4 Illustrative Examples 

The following two examples illustrate the usefulness of Theorem 13.11 

Example 4.1. Let T be a time scale satisfying condition (H) and such that supT = +oo and 
G T. Consider the problem 

+°° / . , \ 2 

At — > max 



(**'(*)) 

ieC r 4 d ([0,+»[,l) 
(0)=0, a; A (0) = l 



4 nn ,^rm (7) 



ton 



x 

By Theorem \3. 1[ if x* is a maximizer to problem ((?]), then x* satisfies the Euler-Lagrange equat 

d 2 L(x) 2 (t) - (d 3 L) A (x) 2 (t) + — (d±L) A \x) 2 {t) =0 Vt e [0, +oo[. 

ai 

Since 

d 2 L(x) 2 (t) = 0, d 3 L{x) 2 (t) = 0, d±L(x) 2 (t) = -2x A \t), 
then the Euler-Lagrange equation is 

x A \t) = Vie[0,+oo[. (8) 

Clearly, 

X*(t) = C\t + c 2 t 2 + c 3 t + c 4 , 

where Ci,c 2 ,C3,C4 6l, is the solution of (|8|). Using the initial conditions x*(0) =0 andx A (0) = 1, 
we get C4 = and c 3 = 1 — c 2 a$ — ci<2§. Using the two transuersality conditions, we will determine 
the value of C\ and c 2 . Since 

T ^M T l(lhL{x.) 3 (T*) - ^(d,L) A (x*) 2 (T')) =0 

is equivalent to 

lim inf (ci(aiT' + a ) 3 + c 2 {a\T' + a ) 2 + (1 - c 2 ao - ciahtaiT' + a )) 

x ci(l + a 2 + ai)(l + ai)| = 0, 
t/ten we conclude that c\ — 0. Using the transversality condition 



that is, 



lim inf {atL^^Cr') • x? (T')\ = 0, 



lim inf {-2c 2 (l + at) • (c 2 (T' + a x T' + a ) + 1 - c 2 a )} = 0, 

T^ + oo T'>T 
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we conclude that c 2 = 0. Hence, £E*(i) — t is a candidate to be a maximizer to problem (JSJ). Since 



lim inf 

T^+oo T'>T 



T' 



L(t,x° (t),x?*{t),x* {t))-L{t,x% (t),< A (i),xf (t)) 

lim inf 

T->+oo T'>T 



At 



(x* (t)y 



At<0 



for every admissible function x, then x* is indeed a solution to problem (|8j). 

In what follows, we use the standard notation of quantum calculus (see, e.g., [24] 



D q [y]iP) ■■= 



y(qt)-y(t) , M > 



and D 2 Jy}(t) := D q [D q [y]](t). 



(q-l)t 

Example 4.2. Fix q > 1 and let T = g Nt) . Consider the following non- autonomous problem: 



' -i(i + (D^](t)) 2 ) d,t- 

a:(l) = a, D g [x](l) = /3, 



(9) 



where a and jj are fixed real numbers. By Theorem \3.1[ if x* is a maximizer to problem ([9]). £/ien 
musi satisfy the Euler-Lagrange equation 



Since 



d 2 L{x) 2 {t) - D q [d 3 L}(x) 2 (t) + -D 2 q [d A L]{x) 2 {t) = Vt G [l,+oo[ 



d 2 L(x) 2 (t) = 0, d 3 L(x) 2 (t) = 0, d 4 L(x) 2 {t) = -2tD 2 q [x](t), 



then the Euler-Lagrange equation takes the form 



D 2 q [2t D 2 [x}] (t) = Vie[l,+oo[. 



(10) 



If is easy to see £/ia£ a;*(i) = kit 2 + fc 2 i + fcaiini + k 4 is the general solution of equation (TT 
Using the initial conditions we obtain 

k 2 = P - fci(l + q) - k 3 —!—-\nq 
9-1 



k 4 = —/3 + k\q + k 3 In q + a. 

9-1 



Using the transversality condition 



T hm^nf T | (d 3 L{x*) 2 {T') - -^[d 4 L](.T*> 2 (T')) • x*{qT')} = 

we get fc 3 = 0. The transversality condition 

lim inf \d 4 L(x^) 2 (T') ■ Dg[xJ(T')\ = 

implies that k\ = 0. Hence, x*(t) — fit — (3 + a is a candidate to be a maximizer. Using the 
definition of weak maximality, we conclude that x*(t) = (3t — (3 + a is indeed a maximizer to 
problem |9]). 
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5 Concluding Remarks 



We have established Euler-Lagrange and transversality optimality conditions for higher-order 
infinite horizon variational problems on a time scale. The results were obtained for weakly optimal 
solutions in the Brock sense. The main result is Theorem l3.il which generalizes the recent results 
of [15] and [16]. Moreover, the new necessary optimality conditions improve the classical results 
both in the continuous and discrete settings: if one chooses the time scale to be the set of real 
numbers, then Theorem 13.11 improves the continuous results of [T7]; if one chooses the time scale 
to be the set of integers, then Theorem 13.11 improves the discrete-time results of [IS] . 
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